BrainBrush, a Multimodal Application for Creative Expressivity
نویسندگان
چکیده
We combined the new developments of multimodal Brain-Computer Interfaces (BCI) and wireless EEG headsets with art by creating BrainBrush. Users can paint on a virtual canvas by moving their heads, blinking their eyes and performing selections using a P300 BCI. A qualitative evaluation (n=13) was done. A questionnaire was administered and structured interviews were conducted to assess the usability and user experience of the system. Most participants were able to achieve good control over the modalities and able to express themselves creatively. The user experience of the modalities varied. The use of head movement was considered most positive with the use of eye blinks coming in second. Users were less positive about the use of the BCI because of the low reliability and higher relative cost of an error. Even though the reliability of the BCI was low, the BCI was considered to have an added value: the use of BCI was considered to be fun and interesting. Keywords-Creative Expression, Brain-Computer Interface, Multimodal Interaction, P300
منابع مشابه
Typed Hybrid Multimodal Logic
Some potential application domains of hybrid multimodal logic strongly suggest typing of states and imposing type–constraints on modalities. We investigate logical/computational cost of such an extension, and find out that, in the case of a very simple system of types, there is none: the extension essentially preserves both expressivity and complexity of hybrid multimodal logic. Use of types sh...
متن کاملMultimodal Expressive Embodied Conversational Agents [Multimodal expressive ECAs]
In this paper we present our work toward the creation of a multimodal expressive Embodied Conversational Agent (ECA). Our agent, called Greta, exhibits nonverbal behaviors synchronized with speech. We are using the taxonomy of communicative functions developed by Isabella Poggi [22] to specify the behavior of the agent. Based on this taxonomy a representation language, Affective Presentation Ma...
متن کاملAssociations between Resilience and Quality of Life in Nurses: The Mediating Role of Emotional Expressivity
Background and purpose: Nurses deal with many tensions that can have negative influences on their mood, job performance, and quality of life. The aim of this study was to investigate the mediating role of emotional expressivity on resilience and quality of life among nurses. Materials and methods: In this correlational study, the participants included 204 nurses selected from three hospital...
متن کاملA multimodal corpus for gesture expressivity analysis
This work presents the design and implementation of corpus recording sessions along with some preliminary processing results. Captured modalities include speech and facial expressions but the focus is on hand gesture expressivity. Thus, this is the primary modality and is recorded using three methods: bare hands, Nintendo Wii remote controls and datagloves. Such a setup allows for multimodal af...
متن کاملUsing human physiology to evaluate subtle expressivity of a virtual quizmaster in a mathematical game
The aim of the experimental study described in this article is to investigate the effect of a lifelike character with subtle expressivity on the affective state of users. The character acts as a quizmaster in the context of a mathematical game. This application was chosen as a simple, and for the sake of the experiment, highly controllable, instance of human–computer interfaces and software. Su...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2012